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Abstract. Intrinsic random functions (IRF) provide a versatile approach when the assumption 
of second-order stationarity is not met. Here, we develop the IRF theory on the circle with its 
universal kriging application. Unlike IRF in Euclidean spaces, where differential operations are 
used to achieve stationarity, our result shows that low-frequency truncation of the Fourier series 
representation of the IRF is required for such processes on the circle. All of these features and 
developments are presented through the theory of reproducing kernel Hilbert space. In addition, 
the connection between kriging and splines is also established, demonstrating their equivalence on 
the circle. 
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1. Introduction. When a random process is considered on a circle, it is often assumed to 
be second-order stationary (or stationary for short in the paper), that is, the mean of the pro¬ 
cess is constant over the circle and the covariance function at any two points depends only on 
their angular distance (Yaglom, 1961, Roy, 1972, Roy and Dufour, 1974, Dufour and Roy, 1976, 
Wood, 1995, Gneiting, 1998). While stationarity is commonly assumed, it is often considered to 
be unrealistic in practice. In Euclidean spaces, a large class of non-stationary phenomena may be 
represented through intrinsic random functions (IRE, Matheron, 1973, Cressie, 1993, Chiles and 
Delfiner, 2012). The properties of IRE in other spaces, such as the circle or sphere, are not widely 
known. In this paper, the theory of IRE on the circle is developed, where we find that instead of 
differential operations, truncation of the Eourier series representation becomes essential for IRE on 
the circle. This can be presented in the context of the reproducing kernel Hilbert space (RKHS, 
Aronszajn, 1950, Wahba, 1990a). We formally make such a connection and further relate universal 
kriging with the smoothing formula in RKHS. Based on this approach, we are able to demonstrate 
the equivalence between splines and kriging on the circle. 

2. IRE and RKHS. A key component for IRE is the allowable measure. Based on Matheron 

(1973) and Chiles and Delfiner (2012, Chapter 4), a discrete measure A = ^ 

circle 5, where G S', A* G M and (5(-) is the Dirac measure, is allowable at the order of an integer 
k(k > 0) if it annihilates all trigonometric functions of order k < k. That is, 

m m 

Xi cos{kti) = Xi sm{kti) = 0, 0 < k < k. (1) 

i=l i=l 

We call Aft the class of such allowable measures. Clearly Aft+i C A^. In addition, for A G A^, the 
translated measure itX = Xi5{ti -|- t),t G S remains in A^. This can be easily seen from the 

elementary trigonometric identities (also see Matheron, 1979, Chiles and Delfiner, 2012). Eor any 
function /(•) on S, we define /(A) = Xif{ti). 

In this paper, we consider a random process {Z{t),t G S} on a unit circle with finite second 
moment and being continuous in quadratic mean. By Yalgom (1961) and Roy (1972), the process 
can be expanded in a Eourier series which is convergent in quadratic mean; 

CX) 

z{t) = zq + yy (z„, ccosnt + Zn^sSiTint), (2) 

n=l 
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where Zq = l/(27r) Jg Z{t)dt, Zn,c = (1/^) Jg Z{t) cos ntdt, and Zn,s = (1/"^) Jg Z{t) smntdt. 


Definition 2.1. For an integer k(k > 0), the random process in ([2]) is called an IRFk if for any 
A € Ak, the process 

m 

Z\{t) = Z{itX) = XiZ{ti + t) 

i=l 

is stationary with respect to t € S' and has a zero mean. 


To characterize such a circular IRFk, we denote 

OO 

Z:^{t) = y~](Zyt^eCos nt + Zn^s siunt), 

n=K. 

as its low-frequency truncated process and so we have the following Lemma. 


Lemma 2.1. A random process given by (l2|) is an IRFk if and only if its low-frequency truncated 
process Zf.{t) is stationary and has a zero mean. 

Proof. In the Fourier expansion ([2]), the lower trigonometric functions will be annihilated by A € A^, 
which implies 

OO / m m 

Z{itX) = Un, c ^^(Aj cos nti cos nt — Aj sinntj sinnt) -|- Zn^s A* sinnL cos nt + cos nti sinnt) 
n=K \ 1=1 i=l 

Denote Xn,c = YT=i cos nti, Xn,s = YT=i sin nti and 

hn,c — Zfi (,Xn^c A Zn,sXn,S) — Zn,cXn,s A An,o ^ — K, K , (3) 



we have 

OO 

Z{itX) = '^^{Yn^c cos nt+ Yn^s sin nt). 

n=K, 

Yaglom (1961, Theorem 5) shows that a random process ([2]) on the circle is stationary if and only 
if its Fourier coefficients are uncorrelated random variables. The Lemma can be directly obtained 
based on this and the linear mapping between the coefficients of {Zn,c, Zn,s) and (Yn^c,Yn,s) in 

©. □ 
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Remark 2.1. In Euclidean spaces, the IRE is associated with differential operations (Matheron, 
1973, Chiles and Delfiner, 2012). Eor example, a differentiable IREk on a real line is characterized 
as that its {k + 1) derivative is stationary. Lemma 2.1 indicates that for circular processes, the 
low-frequency truncation operation replaces differential operations and leads to stationarity. This 
observation also has important implications for splines on the circle, which is addressed in Section 4. 

Remark 2.2. R is clear that an IREO on the circle is the conventional stationary process. Note 
that this is slightly different from what has been defined in the Euclidean spaces, where IRE(—1) 
is usually a stationary process. Eor the rest of this paper, we assume k >1 for notational simplicity. 

Remark 2.3. Based on Lemma 2.1, for an IREk process Z{t), the random process 

K.— 1 

Z*{t) = Z{t) + Aq + '^{An. c COS nt -|- An^s sin nt ), 

n=\ 

where Aq, A^^c, An^s,n = 1,..., (k — 1) are random variables, is clearly also an IREk. These two 
processes Z{t) and Z*{t) share the same truncation process Zf^{t), with Z*{X) = Z(X), for any 
A € Aft. Similar to the discussion in Chiles and Delfiner (2012, Section 4.4.2), these functions form 
an equivalent class. 

To obtain the covariance function of Zfi{t) of an IREk, based on Yaglom (1961) or Roy (1972), 
we denote 

^{,Zn,cZm,c) — ^{,Zn,sZm,s) — 5{n 

with 7 n > 0, n > K, and 'Xn < cc- Here 5{n — m) = 1 if n = m and 0 otherwise. This leads to 

OO 

cov(Zft(x), Zft(?/)) = ^7„cosn(x-y) := (j){x-y), x,y £ S. 

n=K, 

This covariance function plays an essential role in our paper, and is named as the intrinsic 
covariance function of the IRE^t. 

Remark 2.4. Another component in IRE is the generalized covariance function. Eor an IREk 
on the circle, it is clear that (/>(•) is a candidate of te generalized covariance function. By the 
annihilation property of allowable measures, any function which is the sum of (/>(•) and a linear 
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combination of lower trigonometric functions up to order k — 1 can also be a generalized covari¬ 
ance function. A basic property of the generalized covariance function in Euclidean spaces is its 
conditional positive definiteness. Such a property (Levesley et al. 1999) seems less important on 
the circle. One can clearly show that (/>(•) is conditional positive definite of order k, and positive 
definite simultaneously (Schoenberg, 1942). For example, it is noted by Yaglom (1961) that the 
space of valid variograms coincides with the space of valid covariances. 


RKHS was introduced in Aronszajn (1950), and is popularly used in the spline literature (see, 
for example, Wahba, 1990a). Taijeron et al. (1994) and Levesley et al. (1999) have studied RKHS 
in the context of spline interpolation and smoothing on the circle and sphere. Here, we formally 
establish the connection between IRE and RKHS on the circle. First, given an IRFk process and 
its intrinsic covariance function (^>{6) = 7n cos n 0 , 7 ^ > 0, one can dehne a function space 

on 5, following Levesley et al. (1999) 

C 00 00 ^ 

Ak = < f{t) = ao + {an,c cos nt + an,s sin nt ), t e S : ^ —(a^ ,, J < 00 



For f,g G A^, a semi-inner product is dehned 
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if 1 9)K — ^ ^ {o-n,c,f(^n,c,g 


n=K 


( 4 ) 


There is a nil space for this semi-inner product N = span{l,cost,sint,. .. ,cos(k — l)t,sin(«; — l)t}. 
Denote I = dim(A), and it is clear that I = 2k — 1. Let {ri, ... ,ti G S} he a set of distinct points 
such that for every p(-) G N, if p{T,y) = 0 for all u = 1,... ,1, then p = 0. Then, the inner product 

l 

if, 9) fiTu)giTu) + if, 9 )k 

u=l 

is well defined and A^ can be shown to be complete with respect to the norm induced by this 
inner product (Levesley et al. 1999). In addition, there exist pi{t),... ,pi{t) G N, such that 
Pui^g) = 5{v,p) iov 1 < V, p < 1. As discussed in Levesley et al. (1999), the space A^ is a Hilbert 
function space in which point evaluations are continuous linear functionals. Therefore, for x,y G S, 
there exists a reproducing kernel 

i i i i 

H{x,y) = (l){x-y)-'^ (())(x - T^)pu{y) + 4>{y - Tu)Pu{x))+^'^(t){T^-T^)py{x)pi,{y)+^py{x)p^{y). 

V=1 V=1 /i=l V=1 

( 5 ) 
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Proposition 2.1. H{x,y) is positive definite for x,y G S. 


Proof. By the expansion of 4>{6) = Yl'^=K'yrLCOs{n9), we have 


U=1 


H{x,y) = 'Y^Pu{x)pu{y) + X] cos(nx) -'^cos{nT^)pu{x) cos(ny) - ^cos{nT„)p„{y) 
u=l n=K \ u=l J \ 

+ ^7n sin(na;) - '^sin{nTy)py{x) sin(ny) - y~]sin(nT^)p^(y) 


U=1 


u=l 


The positive dehniteness of H{x,y) can be obtained through the symmetry in x and y along with 
7 n > 0 for all n > k. □ 


Remark 2.5. We show that for an IRF/t on the circle, there exists a corresponding RKHS. 
Conversely, given the positive definiteness of H{x,y), there exists a Gaussian random process that 
is an IRFav with H(x,y) as its covariance function. Therefore, the connection between IRF and 
RKHS on the circle has been formally established. 


Remark 2.6. One can easily verify the reproducing property of this kernel (Taijeron et ah 
1994, Light and Wayne, 1995, Levesley et al. 1999). The different choice of the distinct points 
{ri,..., Ti} will alter the form of the reproducing kernel with (/>(•) unchanged since the terms con¬ 
taining Pui') will all be annihilated by A € A^. 


3. Univesal kriging. Universal kriging associated with IRF is widely used in spatial statistics 
(Cressie, 1989, Chiles and Delfiner, 2012). In this Section, we will discuss universal kriging on 
the circle. Let Z{t) be an IRFk with an intrinsic covariance function (/>(•) and the mean function 
E(Z(t)) = 1 where (5^.,^ = 1,...,/ are coefficients and span{qi{t),... ,qi{t)} = N. 

Here q,/{-) can be the elementary lower trigonometric functions or {pi/(t)}[y=i given in Section 2. 
Assume that the data {{ti, yi),i = 1..., n}, n > I, are observed from this IRFk with measurement 
error 

Y{t) = Z{t) €{t), t G S, 

where e(-) is a white noise process with mean zero that is uncorrelated with the process Z{-). 


6 


To obtain the best linear unbiased estimator at to £ S, the universal kriging is commonly used, 
where the linear estimator is 

Z{to) = V^y, V = {Vi,-■ ■ ,Vnf, 

with coefficients r] = (r?j)nxi- The unbiasedness leads to ^ where 

Q = {qu{ti)}n^h q = {qi{to), ■■■, qiito))'^, 

and therefore Viqji'^i) — qj{to),j = 1,2 ,... ,1, which implies 

n 

- (5(to) G K- (6) 

i=l 

Hence, the squared prediction error can be shown to be 

E(Z(to) - Z{tQ)f = - 2rf cj) + ^(0), 

where 

T = {0(ti - tj)}nxn, 4> = - ffi), • • • , 4>{tn “ 

The goal of universal kriging is to minimize the squared prediction error, subject to the unbiasedness 
constraints. Letting a vector p of / x 1 be the Lagrange multipliers, we need to minimize 

M{7]) = — 2q^(l) + (j){0) + 2{rf^Q — q^)p. 

Direct computation finds the universal kriging formula as 

f (T + + Qp = 0, 

1 = q- 

Next, we show that this universal kriging formula can be interpreted in the content of RKHS. 
With this IRFk Z{-) and the observed data {(ti,yi),i = 1... ,n},n > I, the smoothing problem is 
to find a function fait) G such that it minimizes (Taijeron et al. 1994, Levesley et al. 1999) 

n 

'^iVi- fiti))"^ + a\\f\\l, 

i=l 

where a > 0 is the smoothing parameter and || • ||k is induced by the semi-inner product (jH) in 
Section 2. The minimizer can be shown to be 

I n 

fait) = '^dyqyit)+ '^Ci(t)iti-t), (8) 

v=l i=l 
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where c = (ci)nxi and d = {du)ixi satisfy the following, 


('h + al)c + Qd = y, 

Q^c = Oixi- 

To show the connection between this smoothing formula and universal kriging ([7|), note that the 
smoothing formula for an unobserved point to G S can be rewritten in the following manner 


= ( 2 / ,0ixl) 




where 


^ + al Q 




Olxl 


or 


(9) 


(T + al)r]* + Qp* = 0, 

Q'^P* = q. 

Remark 3.1. This equation ([9]) is exactly the dual formula of universal kriging (Cressie, 1993, 
Chiles and Delfiner, 2012). Usually, universal kriging is viewed as a linear estimator of observed 
data and the smoothing formula is viewed as linear combination of the intrinsic covariance with 
lower trigonometric trends. From the above discussion, these two views are essentially the same. 
The connection between universal kriging and the smoothing formula, therefore, is obvious. 


Remark 3.2. The smoothing parameter a in ([9]) and the noise variance cr^ in ([7]) play the 
same role. For example, in the smoothing formula, when ol increases to inhnity, the minimization 
procedure demands ||/||k 4- 0, which shows that c —>• 0, and the smoothing formula reduces to the 
trigonometric regression (Eubank, 1988). In kriging practice, when increases to infinity, the 
noise overwhelms the spatial dependency, the process becomes uncorrelated. The squared predic¬ 
tion error is dominated by The universal kriging reduces to minimize p^p subject to the 

unbiasedness restriction, which also leads to trigonometric regression prediction. When both a and 
decrease to zero, both smoothing and kriging result in exact interpolation. 


Remark 3.3. In this paper, we extend IRF to the circular setting through the RKHS theory. 
In so doing, we find that the lower monomials in Euclidean spaces need to be replaced by lower 
trigonometric functions, and the differential operators need to be replaced by low-frequency trun¬ 
cations. The RKHS sheds light into kriging on the circle and provides elementary understanding. 
This RKHS approach allows us to revisit splines on the circle, see Section 4.1. 


4. Examples and discussions. 

4.1 Spline on the circle. In Craven and Wahba (1979) and Wahba (1990a), the spline on the 
circle is the minimizer of 

n 

+ aJ{f), 

i=l 

where 

J{f) = (10) 

This minimizer has been shown to be (Wahba, 1990a) 

n 

fa{t) = d + y^^CiR{ti,t), 

i=l 


with 

oo ^ 

R{s,t) = 2^^^cosn(s-t). 

n=l ” 

Remark 4.1. This is the smoothing formula ([8]) for k = 1, where the intrinsic covariance 
function is replaced by R{s,t). Note that the spline kernel R{s,t) is a specified function, for 
example. 


m = 1, R{s, t) 
m = 2, R{s, t) 


(s — t)^ 7r|s — 7r^(s — t)^ 

24 6 6 45' 


These kernels R{s, t) are clearly positive definite (Schoenberg, 1942) on the circle, and are valid 
covariance functions. 


Remark 4.2. In Euclidean spaces, the order m in (jlOl) plays a significant role. It indicates the 
smoothness assumption of the function, and relates to the order of IRE in kriging (Kent and Mardia, 
1994). However, for this spline on the circle, this order m only alters the covariance functions (see 


9 






Remark 4.1), and loses its connection to the order k of IRF. Therefore, the spline with derivative 
penalty has limited application for circular processes. As shown in Lemma 2.1, the low-frequency 
truncation operation shall be used, leading to the more appropriate spline model on the circle 

n 

-Ete-/(*<))"+“ii/iil (“) 

^ • 1 
2 = 1 

where || • ||k is induced by the semi-inner product ([!]) in Section 2. A more general approach for 
hyperspheres can be found in Taijeron et al. (1994). 

4.2. Splines and kriging. The spline model (llip is exactly the same as the smoothing for¬ 
mula in Section 3, where the equivalence between the smoothing formula and kriging is discussed. 
It is clear that this spline dill) and kriging are also equivalent on the circle. The RKHS theory 
on the circle offers a clear view of this connection. In addition, following Remark 3.1, spline is 
a linear combination of the intrinsic covariance functions with lower trigonometric trends, while 
universal kriging is a linear estimator of observed data. They arrive at the same conclusion as dual 
formulations of kriging (Cressie, 1993). 

The connections between splines and kriging have been extensively discussed in literature, in¬ 
cluding Matheron (1981), Watson (1984), Lorenc (1986), Cressie (1989, 1990, 1993), Wahba (1990a, 
1990b), Kent and Mardia (1994), Laslett (1994), Furrer and Nychka (2007) among others. Furrer 
and Nychka (2007) show that, given a covariance function, one can construct a reproducing kernel 
and obtain a general spline estimate in Euclidean space. In this paper, we show this connection 
formally for circular processes using the IRFs. 

4.3. Ordinary kriging. The ordinary kriging is well known and has been widely used in a 
variety of spatial analysis contexts. On the circle, ordinary kriging is equivalent to the universal 
kriging developed in Section 3 with k = 1. The process Z{t) is IRFl with mean and covariance 

E(^(i)) = (3i, cov{Z{x),Z{y)) = H{x,y) = (p{x - y) - 4>{x - ri) - 4>{y - n) + 0(0) -h 1. 

The process is not stationary, but a direct computation gives var(Z(x) — Z{y)) = 20(0) — 20(x — y). 
That is, the variance of the process at two points only depends on their circular distance and we 
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can define 


r(6») := 0(0) - 0(6») = ^7n(l - cosn6»), 

n=l 

as the semi-variogram (Schoenberg 1942, Huang et al. 2011). The process can be viewed as 
intrinsically stationary on the circle. Note that 0(0) relates to the semi-variogram directly through 
(Huang et al. 2011) 

4>i0) = co-t{9), co>- [ T{6)d6. 

TT Jo 

Therefore, with r = (r(fi — to ),..., r(t„ — , 1„ = (1,1, • • • , 1)^, and T = {r(0 — tj)}, we have 

the kriging estimator 

fa{to) = rf^y, 

where r] satisfies 

-Tr] + pln = T, 1^7 = 1- 

This is exactly the ordinary kriging in the spatial literature (Cressie, 1993). 

4.4. Brownian bridge. The Brownian bridge € S'} is a random process on the circle 

with mean zero and 

cov{B{s), B{t)) = 27r min{s, t} — st, s,t € S. 

It is clearly not a stationary process. However, for any allowable measure A = YliLi £ Ai 

(hence YT=i = 0); 

m 

cov{B{it\),B{is\)) = ^ XiXj{27:mm{ti + t,tj + s} - {ti + t){tj + s)} 

m m 

= — vr ^ ^ XiXj\ti -\-1 — tj — s| -|- (1/2) ^ ^ XiXj{ti -|- t — tj — s)^, 
i,j=l i,j=l 

where the last equality is based on 2 minja, b} = {a + b) — \a — b\, a > 0,b > 0 and YliLi = 0- 
That is, B{LtX) is stationary with respect to f, showing that the Brownian bridge is an IRFl. 

On the other hand, one can consider the Fourier series representation of the Brownian bridge 

oo 

B{t) = Bq + ccos(nf) -|- Bn,s sin(nf)). 

n=l 
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Direct computation shows that for all n,m > = ^<5(m,n) and 

E{Bn,cBm,s) = 0. Therefore, the truncated process Bi{t) = Yl^=iiBn,cCos{nt) + S„^ssin(nt)) is 
clearly stationary, and so the Brownian bridge is an IRFl by Lemma 2.1. In addition, its intrinsic 
covariance function is given by (/>(s — t) = 2^^^ ^cos(n(s — t)), which is exactly the same as 
the R{s,t) with m = 1 in Subsection 4.1. However, we have E(Ho-Sn,c) = ^ 1) that is. 

Bo is correlated with all Bn^^n > 1. Such a coupling reveals that the Brownian bridge is not sta¬ 
tionary. But, by truncation this coupling is removed, and the truncated process becomes stationary. 
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